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PROBLEM TO BE SOLVED: To recognize objects with good 
accuracy even when the objects different in brightness exist 
in an observation region. 

SOLUTION: In an observation device for recognizing the 
parked state in a parking area 4, a slow shutter speed for 
grasping a dark color and a fast shutter speed for grasping a 
bright color are set on a camera 1 , and the parking area 4 is 
continuously photographed at both shutter speeds. A 
control device 2 Individually receives image data, 
synthetically processes the image data, then extracts edges 
on the synthesized image, and judges the presence or 
absence of vehicles for individual vehicle frames. 
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* NOTICES * 
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1 This document has been translated by computer. So the translation may not reflect the 
original precisely. 
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3.1n the drawings, any words are not translated. 



CLAIMS 

[Claim(s)] 

[Claim 1] The image-processing approach characterized by recognizing the object in said 
observation field using the description on this synthetic image after carrying out synthetic 
processing of the image of two or more sheets which picturized the same observation field 
with light exposure different, respectively, and was obtained for every corresponding pixel and 
generating the synthetic image of one sheet. 

[Claim 2] The image-processing approach characterized by recognizing the object in said 
observation field using the integrated result of this description about the image of two or more 
sheets which picturized the same observation field with light exposure different, respectively, 
and was obtained after unifying the description on an image, respectively. 
[Claim 3] The image-processing approach characterized by unifying the recognition result for 
every image and finally recognizing the object in said observation field after recognizing the 
object in said observation field using the description on an image, respectively about the 
image of two or more sheets which picturized the same observation field with light exposure 
different, respectively, and was obtained. 

[Claim 4] Two or more image pick-up means arranged towards the predetermined observation 
field generate the image of two or more sheets by light exposure different, respectively. After 
matching and carrying out the description on each image between images for every group of 
the image generated with the same light exposure by each image pick-up means, unify the 
matching result for each class and said three-dimension match and using result measurement 
processing integrated is carried out. The image-processing approach characterized by 
recognizing the object in said observation field based on the measurement result. 
[Claim 5] An image input means to input the image of two or more sheets which picturized the 
same observation field with different light exposure, and was obtained according to an 
individual, An image composition means which corresponds each inputted image to carry out 
synthetic processing for every pixel, and to generate the synthetic image of one sheet, The 
image processing system which possesses a feature-extraction means to extract the 
description on the generated synthetic image, and a recognition means to recognize the 
object in said observation field using the description extracted by said feature-extraction 
means, and changes. 

[Claim 6] The image processing system which possesses an image input means input the 
image of two or more sheets which picturized the same observation field with different light 
exposure, and was obtained according to an individual, a feature-extraction means extract the 
description on an image about each image which inputted, respectively, a description 
integrated means unify the feature-extraction result for every input image, and a recognition 
means recognize the object in said observation field using the description integrated by said 
description integrated means, and changes. 

[Claim 7] An image input means to input the image of two or more sheets which picturized the 
same observation field with different light exposure, and was obtained according to an 
individual, A recognition means to recognize the object in said observation field about each 
inputted image using the feature-extraction result after extracting the description on an 
image, respectively, The image processing system which possesses a recognition result 
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integrated means to ge^lKte the data in which the recognition reWnt for every image is 
unified and the final recognition result of the object in said observation field is shown, and 
changes. 

[Claim 8] The image processing system which possesses further a brightness detection means 
to detect the brightness in said observation field, and a light exposure adjustment means to 
adjust each light exposure to an image pick-up means to supply each input image, using the 
detection result of said brightness, and changes in the image processing system indicated by 
either of claims 5-7. 

[Claim 9] The image processing system which possesses an image brightness detection means 
to detect the brightness of each image further inputted by said image input means in the 
image processing system indicated by either of claims 5-7, and a light exposure adjustment 
means to adjust each light exposure to an image pick-up means to supply each input image, 
using the detection result of said brightness, and changes. 

[Claim 10] the timer which clocks time of day further in the image processing system 
indicated by either of claims 5-7 — having — the time check of this timer — the image 
processing system which is constituted and changes so that the predetermined period of the 
one day may input only the image of one sheet by specific light exposure and the object in 
said observation field may be recognized based on time of day. 

[Claim 1 1] An image input means to input the image of two or more sheets by light exposure 
which is different, respectively from two or more image pick-up means arranged towards the 
predetermined observation field, A matching means to match the description on each image 
between images for every group of the input image generated with the same light exposure by 
each image pick-up means, The image processing system which possesses an integrated 
means to unify the matching result for said each class, a three-dimension measurement 
means to carry out three-dimension to match and using result measurement processing with 
which it was unified, and a recognition means to recognize the object in said observation field 
using said three-dimension measurement result, and changes. 

[Claim 1 2] the timer which clocks time of day further in the image processing system 
indicated by claim 1 1 — having — the time check of this timer — the image processing 
system of which it consists of and the predetermined period of the one day consists based on 
time of day by the three dimension measurement processing using the description which 
inputs only the image of one sheet by specific light exposure . respectively , and corresponds 
between each input image from each image pick-up means so that the object in said 
observation field may recognize . 



[Translation done.] 
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DETAILED DESCRIPTION 

[Detailed Description of the Invention] 
[0001] 

[Industrial Application] This invention processes the image which picturized the predetermined 
observation field with the independent or multiple image pick-up means, and was obtained, and 
relates to the image-processing approach for carrying out various kinds of recognition 
processings, such as existence of the object in said observation field, its magnitude, a 
location, a configuration, and a color, and equipment. 
[0002] 

[Description of the Prior Art] In recent years, in order to observe the object in predetermined 
observation fields, such as a parking situation of the vehicle in a parking lot. and a run state of 
a vehicle path on the street, the observation equipment which used the technique of an image 
processing is developed. While this kind of observation equipment arranges a CCD camera 
(only henceforth a "camera") in the upper part location of the field for observation, the image 
from this camera is continuously capture to a control unit, the description of the object on 
each input image is extract, and when objects are mobiles, such as a vehicle, measurement of 
the migration direction of an object or a rate is further perform by the time series data of a 
feature extraction result. 

[0003] Moreover, to an observation field, two or more cameras are arranged with position 
relation, the image from each camera is captured to a control unit, and the equipment which 
was made to perform three-dimension measurement processing of an object is also proposed. 

[0004] 

[Problem(s) to be Solved by the Invention] However, in observation processing of this kind, 
under the effect of lighting conditions etc., big dispersion may arise in the brightness in an 
observation field, or the object with which reflection factors differ greatly may exist in an 
observation field, and the brightness between each object may differ greatly. Under such a 
situation, it stops storing no brightness of the objects in an observation field within the limits 
of the dynamic range of a camera, and the problem of it becoming impossible to recognize an 
object in part occurs. 

[0005] Let it be a technical technical problem for this invention to recognize each object with 
a sufficient precision, and to improve recognition precision sharply, even if the object with 
which brightness differs exists in an observation field by having been made paying attention to 
the above-mentioned problem, and carrying out recognition processing using the image of two 
or more sheets by different light exposure. 
[0006] 

[Means for Solving the Problem] After the image-processing approach of invention of claim 1 
carries out synthetic processing of the image of two or more sheets which picturized the 
same observation field with light exposure different, respectively, and was obtained for every 
corresponding pixel and generates the synthetic image of one sheet, it is characterized by 
recognizing the object in said observation field using the description on this synthetic image. 
[0007] The image-processing approach of invention of claim 2 is characterized by recognizing 
the object in said observation field using the integrated result of this description about the 
image of two or more sheets which picturized the same observation field with light exposure 
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different, respectively, 



• 



was obtained, after unifying the descniraon on an image, 




respectively. 

[0008] After the image-processing approach of invention of claim 3 recognizes the object in 
said observation field using the description on an image, respectively about the image of two 
or more sheets which picturized the same observation field with light exposure different, 
respectively, and was obtained, it is characterized by unifying the recognition result for every 
image and finally recognizing the object in said observation field. 

[0009] The image-processing approach of invention of claim 4 with two or more image pick-up 
means arranged towards the predetermined observation field For every group of the image 
which generated the image of two or more sheets by light exposure different, respectively, 
and was generated with the same light exposure by each image pick-up means After matching 
and carrying out the description on each image between images, it is characterized by unifying 
the matching result for each class, carrying out said three-dimension measurement 
processing integrated matching and using the result, and recognizing the object in said 
observation field based on the measurement result. 

[0010] An image input means to input the image of two or more sheets which the image 
processing system of invention of claim 5 picturized the same observation field with different 
light exposure, and was obtained according to an individual, An image composition means 
which corresponds each inputted image to carry out synthetic processing for every pixel, and 
to generate the synthetic image of one sheet, a feature-extraction means to extract the 
description on the generated synthetic image, and a recognition means to recognize the 
object in said observation field using the description extracted by said feature— extraction 
means are provided. 

[001 1] The image processing system of invention of claim 6 possesses the same image input 
means as the above, a feature-extraction means to extract the description on an image about 
each inputted image, respectively, a description integrated means unify the feature-extraction 
result for every input image, and a recognition means recognize the object in said observation 
field using the description integrated by said description integrated means. 
[0012] The image processing system of invention of claim 7 possesses the same image input 
means as the above, a recognition means recognize the object in said observation field using 
the feature-extraction result after extracting the description on an image about each inputted 
image, respectively, and a recognition result integrated means generate the data in which the 
recognition result for every image is unified and the final recognition result of the object in 
said observation field is shown. 

[0013] A light exposure adjustment means by which the image processing system of invention 
of claim 8 adjusts each light exposure using the detection result of said brightness to a 
brightness detection means to detect the brightness in said observation field in one 
configuration of said claims 5-7, and an image pick-up means to supply each input image is 
added. 

[0014] A light exposure adjustment means by which the image processing system of invention 
of claim 9 adjusts each light exposure using the detection result of said brightness to an 
image brightness detection means to detect the brightness of each image inputted into one 
configuration of said claims 5-7 by the image input means, and an image pick-up means to 
supply each input image is added. 

[0015] the timer with which the image processing system of invention of claim 10 clocks time 
of day further in one configuration of said claims 5-7 — adding — the time check of this 
timer — based on time of day, the predetermined period of the one day inputs only the image 
of one sheet by specific light exposure, and it constitutes it so that the object in said 
observation field may be recognized. 

[0016] An image input means by which the image processing system of invention of claim 1 1 
inputs the image of two or more sheets by light exposure which is different, respectively from 
two or more image pick-up means arranged towards the predetermined observation field, A 
matching means to match the description on each image between images for every group of 
the input image generated with the same light exposure by each image pick-up means, An 
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inte'grated means to un^P^e matching result for said each class.^^^ree-dimension 

measurement means to carry out three-dimension measurement processing integrated to 

match and using the result, and a recognition means to recognize the object in said 

observation field using said three-dimension measurement result are provided. 

[0017] the timer with which the image processing system of invention of claim 12 clocks time 

of day further in the configuration of said claim 1 1 — adding — the time check of this timer - 

- the predetermined period of the one day inputs only the image of one sheet by specific light 

exposure from each image pick-up means, respectively, and based on time of day, it is 

constituted by the three-dimension measurement processing using the description which 

corresponds between each input image so that the object in said observation field may be 

recognized. 

[0018] 

[Function] Also when the object with which brightness differs exists in an observation field by 
picturizing the same observation field with light exposure different, respectively, it becomes 
possible to make each object appear on the image by one of light exposure, respectively. 
[0019] In invention of claims 1 and 5, since the image of all the objects in an observation field 
can be made to appear on the image of one sheet by carrying out synthetic processing of 
each image obtained by doing in this way, it becomes possible using the description on this 
synthetic image to recognize each object with a sufficient precision. 
[0020] In invention of claims 2 and 6, after extracting the description on each image by 
different light exposure, by unifying each feature-extraction result, it becomes possible to 
acquire the description concerning all the objects in an observation field, and each object can 
be recognized with a sufficient precision using this description integrated. 
[0021] In invention of claims 3 and 7, since each recognition result is unified and final 
recognition processing is performed about each image by different light exposure after 
performing recognition processing of the object which appeared on the image, respectively, all 
the objects in an observation field can be similarly recognized with a sufficient precision. 
[0022] In invention of claims 8 and 9. since light exposure is adjusted to an image pick-up 
means to supply each image, using the brightness of the inside of an observation field, or an 
input image, even if it changes the brightness in an observation field by change of a perimeter 
environment, the image which caught the description of an object vividly is generable. 
[0023] In invention of claims 4 and 1 1 , since the description on an image is matched for every 
group of the image generated with the same light exposure by each image pick-up means and 
the matching result for each class is unified in case an observation field is picturized with two 
or more image pick-up means and three-dimension measurement processing is performed, the 
focus concerning the object point of all the objects in an observation field can be matched. 
Therefore, by [ this / that matches and carries out three-dimension measurement processing 
using a result ] having been unified, the three-dimension configuration and spatial position of 
each object can be recognized with a sufficient precision, 

[0024] invention of claims 10 and 1 2 — the time check of a timer — since time of day 
performs recognition processing only using the image by specific light exposure within [ of the 
one day ] a predetermined period, unnecessary processing of a time zone in which the high 
object of lightness, such as Nighttime, is not detected is avoidable. 
[0025] 

[Example] Drawing 1 shows the example of installation of the observation equipment for 
parking lots with which this invention was applied. It is for recognizing whether the vehicle has 
parked this observation equipment within each parking limit to the parking area 4 classified 
into two or more parking frames, and fixed support of a camera 1 and the control unit 2 is 
carried out on the stanchion 3 installed in the near location of the parking area 4. 
[0026] Said camera 1 is attached in the up location of a stanchion 3 through bearing-bar 3A, 
picturizes the parking area 4 from a slanting upper part location, and generates an image 
including the whole area. This image is captured by the control unit 2, one of recognition 
processings which carries out a postscript is carried out. and it is recognized whether a 
vehicle exists within each parking limit. This recognition result is transmitted to external 
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ai^l^ent pin centerjarge, by the transmis^^p 



devices, such as a manUfment pin centerjarge, by the transmisslWT part inside equipment 
(not shown). 

[0027] the inside of drawing, and CB — CW the vehicle under parking — it is — vehicle CB A 
car body is the thing of color with low reflection factors, such as black. On the other hand, 
vehicle CW A car body is each vehicle CB and CW under the conditions by which white etc. is . 
the thing of color with a high reflection factor, and the whole image pick-up field, such as the 
time of fine weather, was illuminated brightly. A difference remarkable in the upper brightness 
appears. 

[0028] The vehicle CB above-mentioned with this observation equipment, and CW While 
setting up said camera 1 so that the shutter speed of 2 passages may perform image pick-up 
actuation continuously so that each vehicle can be recognized with a sufficient precision also 
when both the vehicles with which the brightness on a car body differs greatly have parked a 
car like, the image for every shutter speed is processed integrative, and it is made to perform 
recognition processing by the control unit 2 side. Hereafter, order is explained later on about 
the recognition art in the concrete example of a configuration and each example of a 
configuration of the observation equipment of above-mentioned drawing 1 . 
[0029] (1) 1st example drawing 2 shows the configuration of this 1st observation processor, 
and contains the shutter speed control unit 5 besides the above mentioned camera 1 and a 
control unit 2 as a configuration. The shutter speed control device 5 is incorporated in 
housing of a camera 1, or a control device 2, and sets shutter speed SS of 2 passages, and 
SF (SS >SF) as a camera 1 by turns by adjusting the charge storage time of a CCD image 
sensor according to the image pick-up timing of a camera 1 . 

[0030] A control unit 2 is constituted by the image input section 6 which captures the image 
from a camera 1 , and the recognition processing section 7 for processing the captured image 
(the same is said of the following examples). 

[0031] The image input section 6 possesses two image memories 10S and 10F for memorizing 
the A/D-conversion circuit 8 for carrying out digital conversion of the image data of the 
analog quantity from a camera 1 , and the image data for every shutter speed, the change- 
over section 9, etc. According to image pick-up actuation of a camera 1 , the change-over 
section 9 is for switching the connection place of the A/D-conversion circuit 8, and is shutter 
speed SS of the later one. Obtained image IS To the 1st image memory 10S, it is shutter 
speed SF of the quicker one. Obtained image IF It is stored in the 2nd image memory 10F, 
respectively. 

[0032] Drawing 3 (1) and (2) are each shutter speed SS and SF about the condition which 
showed in said drawing 1 . Input images IS and IF picturized and obtained It is shown, shutter 
speed SS Said vehicle CB Image IS which is the shutter speed (for example, 1 / 30 seconds) 
suitable for catching a dark color like a body color, and was generated by this shutter speed 
**** — it is shown in drawing 3 (1) — as — vehicle CB An image appears vividly. However, 
CW with a white body color If it attaches, the brightness of the correspondence location on an 
image is a saturation state, and it is Vehicle CW on an image. It becomes difficult to recognize 
the description. 

[0033] Shutter speed SF of another side It is the short shutter speed (for example. 1/120 
seconds) suitable for catching the strong reflected light, and is this shutter speed SF. Image 
IF to twist As shown in drawing 3 (2) in a top, it is the vehicle CW with a bright body color. A 
clear image appears. However, this image IF Upper vehicle CB The receiving part becomes 
what bled black and is Vehicle CB. It becomes difficult to recognize the description. 
[0034] Returning to drawing 2 , the recognition processing section 7 of this example consists 
of the image integrated section 11, the feature-extraction section 12, a body detecting 
element 13, etc. In addition, specifically, each configuration of this recognition processing 
section 7 is realized by giving the algorithm for carrying out each processing described below 
to CPU of a computer (the same is said of the following examples). 

[0035] This example is two kinds of above mentioned shutter speed SSs. and SF. Each input 
images IS and IF to twist After compounding in the image of one sheet, the existence of a 
vehicle is recognized for every vehicle frame using the description of this synthetic image. 
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The image integrated sWPbn 1 1 is for carrying out synthetic procWsing of each input image, 
each input images IS and IF ******** — the brightness value G of the pixel to which a 
synthetic image corresponds (i, j) is determined by applying the brightness value gS (i, j) of the 
pixel located in eye an i-th line j train, respectively, and gF (i, j) to the principle shown in the 
following (1)-1-(1)-3. 
[0036] 
[Equation 1] 

<i» j) gF(i. j)<thF AND gs (i. j) ^ths 

(1). 



r 

gs 



1-1 



G (i, i) gF (i, j) gs(i»j)>ths AND gP (i, j) ^thp 



^{gs (i, j) +gF (i, j) } /2 ^m. 



(l)-2 



a)-3 



[0037] in addition, (1) type — setting — thS and thF the threshold defined beforehand — it is 
— thS **** — a brightness value big enough — thF **** — a brightness value small enough 
is set up, respectively. For example, it is thS when the brightness value of each pixel of an 
input image takes the data of 8 bit patterns. To the 240 neighborhoods, it is thF. It is set as 
the ten neighborhoods. 

[0038] each input images IS and IF shown in said drawing 3 (1) and (2) a case — black vehicle 
CB (1) -1 formula applies about a corresponding pixel location — having — shutter speed SS 
late as a brightness value G of a synthetic image (i, j) Input image IS to twist The near 
brightness value gS (i, j) is adopted. Moreover, white vehicle GW (1) -2 formula is applied 
about a corresponding pixel location, and it is quick shutter speed SF as a brightness value G 
of a synthetic image (i, j). Input image IF to twist The near brightness value gF (i, j) is adopted. 
(1) -3 formula will be applied in the pixel location where other vehicles do not exist, and the 
brightness value G of a synthetic image (i, j) will be calculated with each brightness value gS 
(i, j) and the average of gF (i, j). In addition, the average with Pixels gS (i, j) and gF (i, j) may 
express the synthetic approach of an image not only the above but the brightness value G of 
all the pixels of a synthetic image (i, j). 

[0039] Drawing 4 is each input images IS and IF. Above-mentioned (1)-1- (1) The result which 
carried out synthetic processing with the application of -3 is shown, and they are each vehicle 
CB and CW. They are each vehicle CB and CW by adopting as a part the data by the side of 
the image which caught the vehicle with a sufficient precision. The image caught vividly has 
appeared. 

[0040] The feature-extraction section 1 2 scans the filter for an edge extract on this synthetic 
image, and extracts the edge showing the profile of a vehicle. The body detecting element 13 
distinguishes whether based on the location of each parking frame on the image memorized by 
the internal memory, the area of the edge part of an each parking within the limit is computed, 
and a vehicle exists. This distinction result is matched with the discernment data (a label, 
location data, etc.) of each parking frame, and is outputted outside. 

[0041] (2) 2nd example drawing 5 shows the 2nd configuration of observation equipment. They 
are each shutter speed SS and SF by the image input section 6 of a configuration as the 1st 
example also with the same control unit 2 of this example. Obtained images IS and IF It inputs 
according to an individual. Moreover, as the recognition processing section 7, each 
configuration of 2 sets of feature-extraction section 1 2S, 1 2F, the description integrated 
section 14, and the body detecting element 13 is provided, and they are each input images IS 
and IF by each feature-extraction sections 12S and 12F. The edge on an image is extracted 
according to an individual. 

[0042] Drawing 6 (1) and (2) are the input image IS of said d rawing 3 (1) and (2). The edge 
image ES generated by edge extract processing in which it received, and EF It is shown. In 
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addition, in order to cl^l^the extract location of each edge, as ^^^e edges of the parking 
frame on an input image were extracted, it is illustrating here. 

[0043] Edge image ES In a top, they are two vehicles CB and CW. Vehicle CB which appeared 
vividly on the image among the parking locations A and B An edge is extracted in the parking 
location A (the edge shown in the parking location B in drawing by the dotted line of a thin line 
is the thing of imagination). It is the edge image EF on the contrary. In a top. it is Vehicle CW. 
An edge is extracted in the parking location B. 

[0044] drawing 5 — returning — the description integrated section 14 — each input images 
IS and IF about — an edge extract result is unified and the edge image of one sheet is 
generated. This integrated processing is each edge image ES and EF, as shown in the 
following (2) types. Each pixel value bS (i, j) and the OR ("I" shows among (2) types) of bF (i, j) 
are searched for for every corresponding pixel, and it considers as the pixel value of the pixel 
B of the edge image after integration (i, j). That is, the edge image formed of each pixel value 
B (i, j) is both edge images ES and EF. It is what was piled up and all edge extract results will 
be adopted by integrated processing. 
[0045] 
[Equation 2] 

B (i, j) =bs (i, J) IbF (i, j) (2) 

[0046] Drawing 7 shows the result of having unified each edge extract result of said drawing 6 
(1) and (2) using the above-mentioned (2) formula, and the edge has appeared with a sufficient 
precision also in which vehicle CB and the parking locations A and B of CW by the above- 
mentioned OR operation. 

[0047] On this edge image integrated, the body detecting element 13 judges the existence of 
a vehicle for every parking frame, outputs that judgment result like said 1st example, and is 
both vehicles CB and CW. It is detectable with both sufficient precision. 

[0048] (3) 3rd example drawing 8 shows the 3rd configuration of observation equipment. The 
control unit 2 of this example is two kinds of shutter speed SSs, and SF by the same image 
input section 6 as said the 1 st and 2 example. Picturized images IS and IF Each input images 
IS and IF after inputting according to an individual It processes according to an individual, the 
vehicle on each image is detected, each detection result is unified further, and a final 
judgment is performed. 

[0049] The recognition processing section 7 possesses the feature-extraction sections 12S 
and 12F and the body detecting elements 13S and 13F for every input image, and also 
possesses the detection result integrated section 1 5. Each feature-extraction siections 1 2S 
and 12F are the input images IS and IF like the 2nd example, respectively. The edge image ES 
in which edge extract processing in which it receives is carried out and the result is shown, 
and EF It generates. Each body detecting elements 13S and 13F are the corresponding edge 
image ES and EF. In a top, it judges whether a vehicle exists within each parking limit, and 
each judgment result is outputted to the detection result integrated section 15 in the form 
matched with the label in which a vehicle frame is shown. By taking the OR of the judgment 
result for every parking frame, the detection result integrated section 1 5 unifies the vehicle 
detection result on each edge image, and outputs this integrated result as a final vehicle 
detection result. 

[0050] drawing 9 — the edge image ES of said drawing 6 (1) and (2), and EF while being the 
result of using and judging the existence of a vehicle for every parking frame and expressing 
the label number given to each parking frame at the left end column in drawing — each label 
number — matching — each edge image ES and EF every — the judgment result of the 
existence of a vehicle and the final integrated result are shown. In addition, the data in 
drawing "1" shall express a judgment result "with a vehicle", and data "0" shall express the 
judgment result of "having no vehicle", respectively. 

[0051] The example of illustration is the vehicle CB which has attached the label number 
rightward in order from the left, and is in the parking frame (it is equivalent to said parking 
location A) of the label number "1" to each parking frame on said image. Edge image ES 
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Vehicle CW which is de^Red in a top and is in the parking frame t^s equivalent to said 
parking location B) of the label number "8" Edge image EF It is detected in the top. therefore, 
the result of having unified both the detection result — "1" and "8" — it is judged with that 
to which a vehicle exists in any parking frame. 

[0052] (4) Modification of examples 1-3 <1> Each of three above-mentioned examples is 
shutter speed SS of 2 passages, and SF. Although it is made to perform detection processing 
of a vehicle using the image to twist, the image by the shutter speed of not only this but three 
passages or more is generated, and it may be made to perform vehicle detection processing. 
[0053] drawing 10 -12 — respectively — the 1- image memory 10M1 -10MN of N individual 
for the configuration into which each 3rd example was developed being shown, and memorizing 
each image obtained with the shutter speed as N (N>=3) in the image input section 6 It is 
arranged. 

[0054] In the example of drawing 10 , after the brightness average is computed by the image 
integrated section 11 of the recognition processing section 7 for every pixel to which it 
corresponds between each input image and each image is unified, edge extract processing on 
this integrated image is carried out by the feature-extraction section 1 2. Furthermore, 
detection processing of each vehicle in which said edge extract result was used is performed, 
and the result is outputted by the body detecting element 13. 

[0055] The recognition processing section 7 of the example of drawing 1 1 is feature- 
extraction section 12A1 -12AN for every input image. It provides and edge extract processing 
is performed for every input image. About the edge image obtained by said edge extract 
processing, the description integrated section 14 performs OR operation between 
corresponding pixels like said 2nd example, and unifies each edge image. Then, detection 
processing of the vehicle by the body detecting element 13 is performed like the example of 
said drawing 10 . 

[0056] The recognition processing section 7 of the example of drawing 12 is feature- 
extraction section 12A1 -12AN for every input image. And body detecting^element 13A1 - 
1 3AN It provides and vehicle detection processing is performed according to an individual by 
these configurations for every input image. Then, like said 3rd example, each detection result 
is unified by the detection result integrated section 15, the data in which a final detection 
result is shown are generated, and it is outputted outside. 

[0057] Thus, if it is made to perform recognition processing using the image by the shutter 
speed as two or more, also when the dynamic range of a camera 1 can be set up more widely 
and the vehicle of various colors will have parked it. it becomes possible to detect each 
vehicle with a sufficient precision. 

[0058] (5) In each example of the example 4 above 1-3rds, shutter speed is changed and it is 
made to picturize one camera 1 continuously. On the other hand, in the 4th example, as 
shown in drawing 13 , two cameras IS and IF with which different shutter speed was set up 
are arranged, and each cameras IS and IF are operated to coincidence. 
[0059] that drawing 14 indicates the configuration of the observation equipment of above- 
mentioned drawing 13 to be — it is — the image input section 6 of a control unit 2 — each 
cameras IS and 1 — the A/D-conversion circuits 8S and 8F and image memories 10S and 
10F in every F are arranged. In addition, since the configuration of which said 1-3rd examples 
may be introduced into the recognition processing section 7 of this example, the illustration 
and explanation of a detailed configuration about the recognition processing section 7 are 
omitted. 

[0060] However, when introducing the configuration of the 1st or 2nd example into the 
recognition processing section 7, it is necessary to make each cameras IS and IF approach 
as much as possible, and to arrange them, where an optical axis is made parallel so that 
trouble may not arise in integrated processing of an image. In order to amend the gap by the 
parallax between camera IS and IF at the time of integrated processing of an image, it is 
necessary to make it shift in the direction (for it to be a lengthwise direction in the case of 
the example of illustration) in which parallax produces one of images only several pixel 
minutes corresponding to the distance between the opticals axis of each camera furthermore. 
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[0061] (6) Although the^iremple of the 5th ******** captures an^rcige with one camera and 
carries out vehicle detection processing like the example of installation of drawing 1 , as it is 
shown in the camera of this example at drawing 15 , camera IX possessing CCD image 
sensors 17S and 17F of two sheets is used. Images IS and IF of two sheets which the charge 
storage time which is equivalent to said shutter speed SS and SF, respectively is set to each 
CCD image sensors 17S and 17F, and the light which passed the camera lens 16 was given at 
coincidence to each CCD components 17S and 17F. and caught this light figure with different 
shutter speed It is generated. 

[0062] The image input section 6 by the side of a control device 2 possesses the A/D- 
conversion circuits 8S and 8F and image memories 10S and 10F for every input image so that 
the image data from each CCD image sensors 1 7S and 1 7F can be received in coincidence. In 
addition, since which 1-3rd configurations may be introduced into the recognition processing 
section 7 like said 4th example, illustration and detailed explanation are omitted here. 
[0063] according to the configuration of this example — the same observation field — each 
shutter speed SS and SF since you can capture and process the image to twist to 
coincidence, lose the time lag between each input image — it is not necessary to carry out 
shift processing of one of the images like said 4th example on ** at the time of integrated 
processing of an image Therefore, the processing time can be shortened while raising the 
detection precision of a vehicle. 

[0064] (7) They are each shutter speed SS and SF by camera IX possessing the two CCD 
image sensors 17S and 17F as the 5th example of the above also with the same example of 
the 6th ********. The image to twist is generated to coincidence. Drawing 1 6 shows the 
configuration of this 6th example, and a control unit 2 possesses the image input section 6 of 
the same configuration as a previous example, and also contains the image integrated section 
1 1 and a monitor 18. 

[0065] Each image generated by camera 1 X is given to the image integrated section 1 1 
through the image input section 6. and is unified by the same approach as said 1st example. A 
monitor 18 becomes possible [ observing each vehicle on one monitor display ], also when the 
vehicle with which it is for displaying the image generated by this integrated processing, and 
brightness differs in the parking area 4 by this exists. 

[0066] In addition, it is also possible to install said monitor 18 in the location distant from the 
parking area 4, and to transmit the image data by which integrated processing was carried out 
to a monitor 1 8 through a communication line from the body of a control device 2. If it does in 
this way, the situation of the parking area 4 can be grasped correctly also in the area which 
cannot supervise the direct parking area 4. 

[0067] Moreover, it is also possible to add the above mentioned configuration of the 1-3rd 
ones of the recognition processing sections 7 to the configuration of this example, and to 
display the result of an existence judging of the vehicle for every parking frame on said 
monitor 18 with the image by which integrated processing was carried out. 
[0068] (8) 7th example drawing 1 7 shows the 7th configuration of observation equipment. This 
example adds the optical intensimeter 19 to said the 1-3rd ones of configurations, detects the 
brightness in the observation field of a camera 1, and is each shutter speed SS of a camera 1, 
and SF by the degree of that brightness. It is made to carry out an adjustable setup. 
[0069] Drawing 1 8 shows the example of a setting of shutter speed. Said optical intensimeter 
1 9 is what receives the light from an observation field and detects the optical reinforcement. 
Here, they are each shutter speed SS and SF beforehand. The set point (s1-s3, f1-f3) of a 
three-stage is established. They are each shutter speed SS and SF by making the memory of 
the shutter speed control unit 5 memorize, and comparing the detection value lambda of said 
optical reinforcement with the predetermined thresholds thi and th2 (th1> th2). He is trying to 
adopt one of the set points. 

[0070] Thus, since the shutter speed of a camera 1 is controlled by the degree of the 
brightness in an observation field, even if it can set up a big dynamic range with a camera 1 
and changes the brightness in an observation field, stable vehicle detection can be performed. 
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[0071] (9) 8th example ^B^ing 19 shows the 8th configuration o^^^ervation equipment. 
They are each shutter speed SS of a camera, and SF to said the 1-3rd ones of configurations 
like [ this example ] said 7th example. Although the configuration which carries out an 
adjustable setup is added, it replaces with the brightness in an observation field here, and 
they are shutter speed SS and SF by the brightness of each input image. The set point is 
made to change. 

[0072] The two brightness averaging sections 20S and 20F besides the same image input 
section 6 as each 1-3rd configurations and the recognition processing section 7 of either of 
these three configurations and this configuration are arranged by the control unit 2. input 
images IS and IF with which these brightness averaging sections 20S and 20F were memorized 
in image memories 10S and 10F ******** — the average of the brightness value of each 
configuration pixel is computed, and it outputs to the shutter speed control unit 5. The 
shutter speed control unit 5 incorporates each calculation value separately, and is each 
shutter speed Ss and SF. The set point is determined and the shutter speed of a camera 1 is 
controlled based on this decision value at the time of the next image pick-up. 
[0073] in addition — a processing initiation time — each shutter speed SS and SF **** — 
predetermined initial value is set up and it is adjusted to an optimum value by image pick-up 
actuation of future number cycles. 

[0074] Drawing 20 shows the procedure for determining shutter speed. In addition, shutter 
speed SS of the one later here Although the procedure for which it opts is shown, it is shutter 
speed SF of the quicker one. It is determined by the same procedure. 

[0075] At the first step 1 ("ST1 " shows among drawing), brightness averaging section 20S are 
the input image IS from image memory 10S. The average luminance value AVS is computed by 
reading image data. The shutter speed control unit 5 is this calculation value AVS at the 
following steps 2 and 3. Optimum value MS of an average luminance value It compares, that 
comparison result is used and it is shutter speed SS. It determines whether to maintain a 
current value or change. 

[0076] Optimum value MS of said average luminance value It registers with internal memory 
beforehand and is the calculation value AVS of said average luminance value. Optimum value 
MS When a difference is between deltasi from the predetermined threshold deltas2 
(deltas2<deltaS1). all serve as [ steps 2 and 3 ] "NO", and it is shutter speed SS. A current 
value is maintained (step 6). 

[0077] Input image IS When too bright, it is the calculation value AVS of said average 
luminance value. Optimum value MS The difference exceeding a threshold deltaSI in between 
arises. In this case, step 2 serves as "YES", and it shifts to step 4, and is shutter speed SS. 
The set point is updated to one half. 

[0078] On the contrary, input image IS When brightness fails, it is the calculation value AVS of 
said average luminance value. Optimum value MS A difference is less than a threshold deltas2. 
In this case, step 3 serves as "YES", and it shifts to step 5, and is shutter speed SS. The set 
point is updated twice. 

[0079] In addition, shutter speed SS in the above-mentioned steps 4 and 5 Updating may be 
made to add the predetermined value for frequency not only to the example of illustration but 
to the current value (or subtraction). 

[0080] Thus, they are shutter speed SS in the next phase, and SF for every image input. Input 
images IS and IF which correspond, respectively By using and determining, it is based on the 
brightness on the actually obtained image, and they are each shutter speed SS and SF. It can 
adjust appropriately. In addition, it is possible to introduce the configuration concerning 
adjustment of the shutter speed of the 7th and 8 above-mentioned example also into drawing 
15 and the 5th and 6 example shown in 16. 

[0081] (10) Each configuration of each example which carried out the 9th example above has 
a possibility that neither of the images of the vehicles may appear, on the image obtained with 
quick shutter speed under the conditions to which the whole observation field, such as 
Nighttime, becomes dark on the assumption that it processes at the day ranges in which the 
observation under predetermined brightness is possible. 
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[0082] Although the Qt^fcfiguration shown in drawing 21 comp^^^s the image by the 
shutter speed as two or more and performs recognition processing, at nighttime, it stops this 
processing, and it is constituted so that the usual recognition processing using the image of 
one sheet may be carried out. 

[0083] the change of the processing at the time of this Nighttime — the time check of the 
timer 21 of the control unit 2 interior — what is performed based on time of day — it is — 
the time check of a timer 21 — when time of day is within a predetermined period, only the 
latest shutter speed is set to a camera 1. Moreover, the inside of drawing and 22 are less than 
[ 2nd ] image memory 10M2 -10MN. It is the change-over section for turning on and off 
connection with the recognition processing section 7, and this change-over section 22 is set 
off at the same time single shutter speed is set to said camera 1 . moreover, coincidence — 
the function of the image integrated section 1 1 of the recognition processing section 7 — 
stopping — the feature-extraction section 12 and the body detecting element 13 — image 
memory 10M1 from — recognition processing only using image data is performed. 
[0084] In addition, similarly, although the configuration of said drawing 10 is adopted as the 
recognition processing section 7, the control unit 2 of the example of illustration can be set 
up so that processing may be switched in daytime and night, when taking other configurations. 

[0085] Thus, by switching processing at nighttime, unnecessary data processing at the time of 
night is reducible. Moreover, a possibility that an error may arise in a detection result by this 
unnecessary data processing can also be lost, and the precision of vehicle detection can be 
stabilized. 

[0086] (11) 10th example drawing 22 shows the example of installation of the observation 
equipment in the case of using the 10th configuration. The existence of the vehicle for every 
parking frame is judged, each cameras 1A and IB are in the condition of having located the 
optical axis on the same side towards the parking area 4, and three-dimension measurement 
processing in which the image from two cameras 1A and IB was used for this observation 
equipment arranges parallel and an image pick-up side at a vertical list. 
[0087] Vehicles CB and CW with which brightness differs like [ this example ] each 1-8th 
above mentioned examples The shutter speed as two or more is set as each cameras 1 A and 
1 B, and it is made to picturize continuously so that it can detect with both sufficient 
precision. Moreover, in a control unit 2, after performing processing from the extract of the 
focus to matching of the focus which shows a vehicle for every group of the image obtained 
with the same shutter speed from each cameras 1A and IB, each matching result is unified 
and it is made to carry out three-dimension measurement processing. 

[0088] Drawing 23 shows the configuration of said observation equipment. The shutter speed 
control unit 5 is shutter speed SS of fixed 2 passage, and SF like said each 1-3rd examples. 
Setting up by turns, each cameras 1A and IB generate the image by each shutter speed SS 
and SF to coincidence in response to control by this shutter speed control unit 5, 
respectively. 

[0089] A control unit 2 is equipped with the image input section 6 and the recognition 
processing section 7 like each above mentioned example, and changes. The image input 
section 6 possesses the A/D-conversion circuits 8A and 8B and 2 sets of image memories 
(10AS and 10AF) (10BS and 10BF) for every camera, one image memory 10AS of each class, 
and 10BS **** — shutter speed SS of the respectively later one from each cameras 1A and 
1 B Images US and LS to twist It is stored, moreover, image memory 10AF of another side and 
10BF **** — shutter speed SF of the respectively quicker one from each camera The image 
UF to twist and LF It is stored. 

[0090] The recognition processing section 7 possesses each configuration, such as the 
description integrated section 24, the three-dimension measurement section 25, and the body 
detecting element 26, while containing 2 sets of feature-extraction section 12BS, 12BF, and 2 
sets of matching processing sections 23S and 23F. feature-extraction section 12BS and 12BF 
Each images LS and LF obtained by lower camera IB. respectively It is for extracting the 
edge on an image. ******** — Feature-extraction section 12BS Image LS to twist To the 



http://www4.ipdl.ncipi,go.jp/cgi-bin/tran_web_cgi_eije 



04/12/27 



11/13 ^— V 

Bction 23S. the receiving edge extract ^Rult is feature-extraction 
section 12BF. Image LF to twist The receiving edge extract result is given to the 2nd 
matching processing section 23F according to an individual, respectively. 
[0091] shutter speed SS with the 1st matching processing section 23S [ later than each 
cameras 1A and 1B ] The obtained input image Us and Ls ******** — it is for specifying the 
focus which expresses the same object point in space, respectively, and matching both. 
[0092] Specifically, this matching processing is said feature-extraction section 12BS. Image 
LS About each point P extracted in the top constituting [ edge ], it is Image US, respectively. 
It is carried out by extracting the upper corresponding points Q. 

[0093] Drawing 24 shows the concrete method of extracting the corresponding points Q to 
said point P. Matching processing section 23S are the edge image ELS generated by said edge 
extract processing first. About the upper predetermined focus P (x yL), it is the subject-copy 
image LS. Window WL of the predetermined magnitude which makes this point P the central 
point in the location of the upper point P It sets up. Subsequently, the matching processing 
section is Image US. It is said window WL on the epipolar line EP of said upper point P. 
Window WU of the same magnitude It sets up and scans, the following (3) types are performed 
for every scan location, and they are each window WL and WU. The dissimilarity DF of inner 
image data is computed. 

[0094] in addition. (3) types — setting — gL (x y) — window WL the brightness value of an 
inner predetermined pixel — moreover, gU (x y) — window WU The brightness value of an 
inner predetermined pixel is shown, respectively. Moreover, SZ is each window WL and WU. 
Size is shown. Furthermore, m and n are the variables for specifying the pixel in each window, 
and are changed within the limits of said size W. 
[0095] 
[Equation 3] 

SZ SZ 

DF= 2 2 {gL (x+m, YL+xO — gu (x+m, yu+n) } ^ 

111=0 a— 0 

(3) 

[0096] Matching processing section 23S are the window WU in the time of measuring the 
dissimilarity DF called for in each scan location, and this dissimilarity DF becoming the 
smallest. The central point (x yU) is pinpointed as corresponding points Q of said point P. 
[0097] In addition, as described above, since each cameras 1A and IB make a vertical list or 
****** parallel and are arranged, an epipolar line EP becomes perpendicular to a x axis, and it 
is Window WU. It can set up easily and the operation of Dissimilarity DF also becomes easy. 
Moreover, it replaces with the approach of computing Dissimilarity DF in each scan location 
on an epipolar line EP, and is Image US. The point of extracting an edge even in a top, among 
these being located on said epipolar line EP constituting [ edge ] is set up as a 
correspondence candidate point of Focus P, and you may make it calculate Dissimilarity DF 
only about these correspondence candidate point. 

[0098] drawing 23 — returning — shutter speed SF with the 2nd matching processing section 
23F [ quicker than each cameras 1A and IB ] Each obtained input image UF and LF ******** 
— the respectively same matching processing as the above is performed, and integrated 
processing of the matching result by each matching processing sections 23S and 23F is 
carried out in the description integrated section 24. 

[0099] This integrated processing adopts all the groups of the focus matched by each 
matching processing sections 23S and 23F, and the corresponding coordinate data for every 
group of each focus is given to the three-dimension measurement section 25. The three- 
dimension measurement section 25 computes the three-dimension coordinate corresponding 
to each focus for every group of the given focus by applying the coordinate (x yu) (x yL) of 
each focus to the principle of triangulation. 

[0100] In this way, the three-dimension coordinate which corresponds for every group of each 
focus is computed, and it is given to the body detecting element 26. The body detecting 
element 26 distinguishes whether a vehicle exists within each parking limit from the number 
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and its height data of tP^ffocus in each parking frame location. 
[0101] In addition, in order to simplify explanation in this 10th example, they are shutter speed 
SS of each camera, and SF. Although it was made the fixed value, it responds to the 
brightness of an observation field, or the brightness of an input image like said the 7th and 8 
example, and they are each shutter speed SS and SF. An adjustable setup may be carried out. 
Moreover, shutter speed SS and SF As shown not only in one kind but in drawing 1 0 -12, 
after setting up the shutter speed as two or more and matching the focus between images for 
every shutter speed, you may make it unify each matching result As furthermore shown in 
said 9th example, each camera may be made to picturize only with late shutter speed at 
nighttime, and you may constitute so that only 1 set of images may perform three-dimension 
measurement processing. 

[0102] (12) Although each of each examples in which others carried out the example above 
generated with the camera the image of two or more sheets with which shutter speed differs, 
they can generate the image of the object with which brightness differs according to an 
individual not only shutter speed but by adjusting a diaphragm of a camera and the gain of the 
output voltage from a camera. 

[0103] Moreover, although each example of a configuration in the observation equipment for 
parking lots was explained, the candidates for observation may be not only a vehicle but other 
bodies, and an observation field may be the interior of a room here. Although the observation 
equipment of this example is only what recognizes the existence of the vehicle for every 
parking frame, you may make it recognize the magnitude of not only this but a vehicle, a 
configuration, etc., and may make it recognize the body color of each vehicle using the camera 
for color picture generation furthermore. 

[0104] Although the observation equipment for parking lots furthermore shown separately 
makes the stationary vehicle applicable to recognition, also when making applicable to 
recognition mobiles, such as a vehicle which runs a path on the street, it can apply this 
invention. However, if the image for every shutter speed is continuously generated in this 
case, since a moved gap of an object will arise between images, it is desirable to introduce the 
configuration of said 4th or 5th example. 
[0105] 

[Effect of the Invention] Even if a big difference is in the brightness between the objects in an 
observation field since the object in an observation field is recognized using the description on 
this synthetic image after picturizing the same observation field with light exposure different, 
respectively in invention of claims 1 and 5, generating the image of two or more sheets and 
compounding each image, it becomes possible to recognize each object with a sufficient 
precision. 

[0106] In invention of claims 2 and 6, the object with which brightness differs can be similarly 
recognized with a sufficient precision by unifying the feature-extraction result on each image, 
and recognizing the object in an observation field. 

[0107] In invention of claims 3 and 7, since each recognition result is unified and final 
recognition processing is performed with each image by different light exposure after 
performing recognition processing of the object in an observation field, respectively, the 
object with which brightness differs can be similarly recognized with a sufficient precision. 
[0108] In invention of claims 8 and 9, since light exposure is adjusted to an image pick-up 
means to supply each image, using the brightness of the inside of an observation field, or an 
input image, even if it changes the brightness in an observation field by change of a perimeter 
environment, the description of an object can be vividly caught with each image, and stable 
recognition processing can be performed. 

[0109] In invention of claims 4 and 1 1, an observation field is picturized with two or more 
image pick-up means. Since the matching result for each class is unified and three-dimension 
measurement processing is carried out after matching the description on an image for every 
group of the image generated with the same light exposure by each image pick-up means, in 
case three-dimension measurement processing is performed Also when the object with which 
brightness differs is in an observation field, the three-dimension configuration and spatial 
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position of each object^ln be recognized with a sufficient precisiofT 
[01 10] invention of claims 10 and 1 2 — the time check of a timer — by time of day, since 
recognition processing only using the image by specific light exposure is performed within [ of 
the one day ] a predetermined period, it avoids unnecessary processing of a time zone in 
which the high object of lightness, such as Nighttime, is not detected, and can reduce 
equipment cost. Moreover, it also becomes possible to prevent the incorrect measurement by 
the processing besides the need. 



[Translation done.] 
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* NOTICES * 



JPO and NCIPI are not responsible for any 
damages caused by the use of this translation. 



1. This document has been translated by computer. So the translation may not reflect the 
original precisely. 

2. **** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



DESCRIPTION OF DRAWINGS 

[Brief Description of the Drawings] 

[Drawing 1] It is the perspective view showing the example of installation of the observation 
equipment with which this invention was applied. 

[Drawing 2] It is the block diagram showing the 1st configuration of observation equipment. 

[ Drawin g 3] It is the explanatory view showing an example of an input image. 

[Drawin g 4] It is the explanatory view showing the synthetic image of the input image of 

drawin g 3 . 

[ Draw ing 5] It is the block diagram showing the 2nd configuration of observation equipment. 
[Drawing 6] It is the explanatory view showing the edge image obtained by edge extract 
processing of an input image. 

[Drawin g 7] It is the explanatory view showing the result of having unified the edge image of 

drawing 6 . 

[ Drawing 8] It is the block diagram showing the 3rd configuration of observation equipment. 
[ Draw ing 9] It is the explanatory view showing the distinction result of the existence of the 
vehicle for every parking frame. 

[Drawing 1 0] It is the block diagram showing the example which transformed the 1 st 
configuration of observation equipment 

[Dr a win g 1 1] It is the block diagram showing the example which transformed the 2nd 
configuration of observation equipment. 

[Drawing 12] It is the block diagram showing the example which transformed the 3rd 
configuration of observation equipment. 

[Drawing 1 3] It is the perspective view showing the example of installation of the observation 
equipment of the 4th configuration. 

[DjAwing J4] It is the block diagram showing the 4th configuration of observation equipment. 
[Drawing 15] It is the block diagram showing the 5th configuration of observation equipment. 
[Drawing 1 6] It is the block diagram showing the 6th configuration of observation equipment. 
[ Dra win g 17 ] It is the block diagram showing the 7th configuration of observation equipment. 
[ Draw in g 18 ] It is the explanatory view showing the example of a setting of the shutter speed 
in the observation equipment of drawing 1 7 . 

[Drawi n g 19] It is the block diagram showing the 8th configuration of observation equipment. 
lQr3.y!6nE.ZQ] it is the flow chart which shows the configuration procedure of the shutter 
speed in the observation equipment of drawing 1 9 . 

[ Drawi n g 21] It is the block diagram showing the 9th configuration of observation equipment. 
[Dr awin g 22] It is the perspective view showing the example of installation of the observation 
equipment of the 10th configuration. 

[Drawing 23] It is the block diagram showing the 10th configuration of observation equipment. 
[Drawing 24] It is the explanatory view showing the example of matching processing of the 
focus. 

[Description of Notations] 
1, IS, 1F. IX, 1A, IB Camera 
2 Control Unit 

5 Shutter Speed Control Unit 

6 Image Input Section 
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7 Recognition Processinl 
1 1 Image Integrated Section 

12, 12S, 12F, 12BS. 12BF Feature-extraction section 

13, 13S, 13F, 26 Body detecting element 
15 Detection Result Integrated Section 
19 Optical Intensimeter 

23S, 23F Matching processing section 

24 The Description Integrated Section 

25 Three-Dimension Measurement Section 



[Translation done.] 
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